Papers with grounded language learning
Interactive Language Acquisition with One-shot Visual Concept Learning through a Conversational Game (P18-1)
Copied to clipboard
| Challenge: | supervised language learning is limited by the ability of capturing mainly the statistics of training data. |
| Approach: | They propose to use conversational games to train agents to use new knowledge . they propose to mimic and reinforce conversational game and use it in one-shot fashion . |
| Outcome: | The proposed approach is able to acquire information by asking questions about novel objects and use the just-learned knowledge in subsequent conversations in a one-shot fashion. |
Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction (2021.naacl-main)
Copied to clipboard
| Challenge: | Scholarly work in this area uses toy worlds and synthetic linguistic data, but grounded language learning offers several practical and scientific advantages. |
| Approach: | They propose to model teacher-learner dynamics through natural interactions occurring between users and search engines. |
| Outcome: | The proposed model is better than non-grounded models on compositionality and zero-shot inference tasks. |
Learning Latent Semantic Annotations for Grounding Natural Language to Structured Data (D18-1)
Copied to clipboard
| Challenge: | Existing work on grounded language learning does not capture the semantics of correspondences between structured world state representations and texts. |
| Approach: | They propose to learn explicit latent semantic annotations from paired structured tables and texts . they use an adapted semi-hidden Markov model to impose a soft constraint to further improve performance . |
| Outcome: | The proposed framework improves on a semi-hidden Markov model and extracts templates for language generation. |